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Operationalizing Your SSIP Evaluation: 
A Self-Assessment Tool 


During Phase III of your State Systemic Improvement Plan (SSIP), you will assess progress on implementing 
your SSIP. This assessment entails evaluating and reporting on progress toward short-term and long-term 
outcomes as well as the State-identified Measurable Result (SiIMR). The purpose of this tool is to lead those 
within your state responsible for implementing your SSIP evaluation through the process of operationalizing 
your SSIP evaluation plan in tandem with implementation efforts. 


As part of Phase II requirements, you will have developed an initial plan for evaluating your SSIP 
improvement processes and outcomes. An evaluation plan identifies the ways in which you will collect, 
analyze, use, and share data related to your SSIP. More specifically, this plan details what information you 
will collect and how, where, and when you will collect it. It identifies your research methods, those 
responsible for carrying out the plan, and relevant timelines. A high-quality evaluation helps you obtain 
meaningful information to assess implementation progress, identify and address implementation challenges, 
and determine the extent to which you are achieving the intended results. A strong evaluation plan is one 
that is realistic and can be implemented using resources available to your team. Effective evaluation can help 
build a culture of data use within your organization as staff and stakeholders collect, analyze, and use data to 
improve programs. 


Planning and implementing evaluation activities are part of an iterative process. To maximize the effect of 
evaluation resources, it is important to revisit the evaluation plan and identify strengths, gaps, and 
weaknesses. The earlier in the evaluation process you identify challenges, the sooner you can address them 
and the more likely you will be to have high-quality, relevant data to use when you assess and report 
progress on achieving your improvement strategies. 


Use this interactive self-assessment tool to gauge your team’s progress on key components necessary for 
fully executing your SSIP evaluation plan and to identify action steps needed to realize the greatest benefit 
from your evaluation efforts. Download and complete the checklist through individual self-reflection or as 
part of a group discussion. Select the radio button to identify whether each component is Not in place, 
Somewhat in place, or Mostly in place. Hover over a section for more information on that component. 
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Somewhat 


in place 


Mostly in 
place 


EVALUATION ROLES AND RESPONSIBILITIES 


e We have well-defined roles for the following and have 
assigned staff to them: 


e developing, testing, finalizing measures; 


e administering data collection components; 
e receiving, cleaning, and storing evaluation data; 
e monitoring data submissions and quality; 


e analyzing data; and 
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e summarizing results and sharing with stakeholders. 


LINKING ACTIVITIES TO OUTPUTS AND 
OUTCOMES 


e We have clearly articulated the linkages between planned 
improvement strategies and intended outputs and 
outcomes. This articulation includes the following: 


e alogic model or other written or graphical 
representation of these linkages; and 


e identified inputs (e.g., staff, time, resources); planned 
strategies and key activities; countable outputs; and 
measurable short-term, intermediate, and long-term 
outcomes. 


e We have involved stakeholders in linking planned activities n n 
and intended outputs and outcomes. 

e Weare using the logic model (or other representation) to 
guide implementation of improvement strategies and O O 
evaluation. 
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Somewhat 


in place 


Mostly in 
place 


EVALUATION QUESTIONS AND DESIGN 


e We have developed evaluation questions that the 
evaluation will seek to answer, including questions related 
to the following: 

e gauging SSIP implementation progress and the extent 
to which activities have occurred as planned; 

e examining implementation and resulting outcomes of 
the coherent improvement strategies; and 

e examining changes or improvements in infrastructure 
that support the SSIP. 

e We have involved stakeholders in developing or reviewing 
evaluation questions. 


e We have developed a general evaluation design, or Oo oO 
framework, that will guide data collection and analysis. 


DATA COLLECTION 


e We have a clear understanding of the data sources/tools 
we will use to evaluate SSIP implementation and outcomes. 


e We have determined what data we are already collecting 
and what new data collection tools/measures we need to oO oO 
evaluate the SSIP. 


e For areas in which we need new data collection measures, 
we have acquired or developed high-quality 
tools/measures that will produce meaningful data to 
address our evaluation questions. 


e We have a well-defined process for the following: 


e identifying the participants (e.g., administrators, 
parents, teachers) of each evaluation activity and 
soliciting their participation; 


O 
O 


e training personnel responsible for collecting and 
managing data; 


e collecting data from intended participants; and 


e minimizing burden on participants and chances of error. 


Oo OodO QO 
Oo O OO OQ 


e = We have involved stakeholders in plans for data collection. 
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Somewhat Mostly in 


in place place 


DATA ANALYSIS 


e We have a well-defined plan for analyzing data and linking 


results back to the evaluation questions. O H A 
e We have a process in place for storing and cleaning data. O O oO 
e We have a clear vision for how we will use analyses in 
; O O O 
reports and other evaluation products. 
e We have involved stakeholders in plans for data analysis. Oo oO oO 
USING AND SHARING DATA 
e We have a process in place that identifies the following: 
e how often data will be reviewed to assess progress; O Oo Oo 
e who, including stakeholders, will be involved in the 
oO oO Oo 
review; and 
e how wecan make changes to coherent improvement 
: Oo Oo Oo 
strategies as a result of data reviews. 
e We have aclear, documented plan for how we will do the 
following: 
e assess progress toward achieving intended outcomes; Oo ml im 
e _use data to inform and improve next steps in SSIP 
P P o Oo Oo 
implementation; and 
e disseminate evaluation results to stakeholders and 
involve stakeholders in data use. a a oO 
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Somewhat Mostly in 


in place place 


EVALUATION TIMELINE 


e We have established a realistic timeline for obtaining high- 
quality data, and we have a clear understanding of how 
long it will take to accomplish the following: 


e identification, development, and possible testing of 


oO oO O 
measures; 
e data collection; im) oO 
e data cleaning; oO oO Oo 
e data analysis; oO Oo 0 
e writing up of findings; and Oo O Oo 
sharing results with and soliciting input from 
s g g inp n n n 
stakeholders. 
e We review our timeline regularly to assess progress on 
a) O O 


evaluation activities. 
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Action Steps to Move Forward on SSIP Evaluation 


Consider the following questions to guide next steps. 


e Reflect on what specific elements you have identified in the checklist as in place or not in place. What 
do you notice about gaps? 


e What specific actions do you need to take to move forward on your SSIP evaluation? Do you need to 
prioritize these actions? If so, how? 


e What questions about the evaluation do you need to take back to your team? 
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e Whoon your team or, more broadly, in your state needs to be involved to move forward on your SSIP 
evaluation? 


e What outside support or additional resources might you need (e.g., from a TA center, external 
evaluator) to move forward on your SSIP evaluation? 
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Additional Resources 


IDC has a number of resources to support your state with SSIP evaluation, including the following: 


e A Guide to SSIP Evaluation Planning. This guide provides information about the key components of a 
high-quality SSIP evaluation, noted in this checklist, as well as worksheets to help you develop and 
implement your plan. 


e In addition to the above guide, the IDC website has various resources related to evaluating your SSIP, 
such as Building an Effective Evaluation Team and Developing a Logic Model for Your SSIP Evaluation. 


IDC offers states the opportunity to work with an entire team of technical assistance providers, including 


evaluation specialists. To access our services or if you have any questions, please contact your IDC State 
Liaison. 
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